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Abstract 

We present a quantitative study on sensitivities to the top-decay anomalous couplings, 
taking into account realistic experimental conditions expected at Tevatron and LHC. A 
double angular distribution of W and charged lepton in the top decay is analyzed, using 
ti events in the lepton jets channel. In order to improve sensitivities to the anomalous 
couplings, we apply two techniques: (1) We use a likelihood fitting method for full kinematical 
reconstruction of each top event. (2) We develop a new effective spin reconstruction method 
for leptonically-decayed top quarks; this method does not require spin information of the 
antitop side. For simplicity, we neglect couplings of right-handed bottom quark as well as 
CP violating couplings. The 95% C.L. estimated bound on a ratio of anomalous couplings 
reads —0.81 < / 2//1 < —0.70, —0.12 < / 2//1 < 0.14 using 1000 reconstructed top events 
at Tevatron, while —0.74 < / 2//1 < —0.72, —0.01 < / 2//1 < 0.01 is expected with 100k 
reconstructed top events at LHC, where only statistical errors are taken into account. A 
two-fold ambiguity in the allowed range remains when the number of events exceeds a few 
hundred. 


1 Introduction 


The top quark is the heaviest elementary particle discovered up to now. Namely, the top quark 
mass term breaks the electroweak gauge symmetry maximally among all of the observed inter¬ 
actions of elementary particles. For this reason, we expect that the top quark can be used as a 
probe to search into the symmetry-breaking physics. On the other hand, so far reported experi¬ 
mental data from Tevatron on top quark properties are still limited; see e.g. No sign of 

signihcant deviations from the Standard Model (SM) predictions has been seen. 

The number of observed top quark events in the Tevatron Run II experiment is increasing 
steadily and now reaching of the order of a few hundred. Moreover, it is expected that at LHC 
experiment an immense number of top quarks will be produced. Thus, we foresee that detailed 
properties of the top quark will start to be uncovered in near future. 

Among various interactions of the top quark, study of the top quark decay properties is partic¬ 
ularly interesting. In the SM (and many of its extensions), the top quark decays via electroweak 
interaction before hadronization. Hence, the top quark’s spin information is transferred directly 
to its decay daughters, and their distributions can be predicted reliably using perturbative cal¬ 
culations. Thus, the top quark spin can be used as a powerful analysis tool for scrutinizing top 
quark interactions. 

There have been many theoretical studies on how to test top quark decay properties at hadron 
colliders. Non-standard effects on the total top decay width and on the top decay branching 
fractions to polarized W states have been computed in the minimal-supersymmetric standard 
model mil, in a i?-parity violating supersymmetric model [5], and in the top-color assisted 
technicolor model ng. A study was given on how to extract anomalous tbW couplings and 
discriminate different underlying models from combined measurements of the top decay branching 
fractions to polarized Ws and the single top production rates HH. The top quark decay t bW 
was studied within the non-commutative standard model in ^2] • The correlation between t and t 
spins in the ti events has been studied as a mean to investigate decay properties of the top quark 
m cn ca o El. Effects of anomalous couplings on the lepton rapidity and transverse energy 
distribution were briefly discussed in There have also been a vast number of studies on top 
rare decays and non-standard decay channels; see m and references therein. 

In this paper we focus on effects of the anomalous tbW couplings to the distributions of W and 
charged lepton in the decay of top quarks. We estimate sensitivities to (some of) these couplings 
expected at Tevatron and LHC, using Monte Carlo simulations which take into account realistic 
experimental conditions at these colliders. There have been no other quantitative studies, using 
top quark decays, on sensitivities to the top decay anomalous couplings at hadron colliders. 

A sensitivity study of the anomalous couplings using the single top production process was 
given in [20]. Their estimated sensitivities to the anomalous couplings are rather low, due to 
existence of huge background cross sections for Wbb and Wbb + jets processes. The small signal- 
to-noise ratio leads to large statistical as well as systematic errors. In this connection, we note 
that due to lack of data statistics and difficulty in the background estimation, the single top 
production process has not yet been observed at Tevatron [211122- As compared to their analysis, 
our analysis method using ti events in the lepton+jets mode is cleaner and involves controlled and 
small backgrounds. Consequently, our method improves sensitivities to the anomalous couplings 
considerably as compared to the results of [20] . 

In our analysis, we assume that there are only anomalous tbW couplings for the left-handed 

^In addition, there are some indirect constraints on anomalous ttZ and tbW interactions from the precision 
measurements at LEP and from the flavor-changing-neutral-current (FCNC) decays of the bottom quark 



bottom quark and we neglect CP violation. We impose these assumptions, for simplicity of our 
analysis, and also in view of the present bounds on the general tbW couplings. This leaves only 
two independent real anomalous couplings, and our analysis is sensitive only to the ratio of these 
two couplings. See Sec. 2 for details. 

In order to improve sensitivities to the anomalous couplings, we devise two techniques. (1) We 
use a likelihood fitting method for full kinematical reconstruction of each ti event. (2) We develop 
a new method for reconstructing an effective spin direction of the top quark. In particular, the 
new feature of the latter technique is that we do not need to reconstruct the spin of the antitop 
side in the tt events, i.e. we do not make use of the correlation between the top and antitop spins. 
In a separate paper, two of the present authors elucidate theoretical aspects of the effective spin 
reconstructed in this method j2dj . 

As well known, top quarks produced at Tevatron and LHC are scarcely polarized. It is one of 
the major reasons why people have considered correlations between top spin and antitop spin in 
the ti production process [13 El [13113 El; with the help of this correlation, one can, in principle, 
reconstruct the information of the top quark spin, by looking into the information on the antitop 
side. Nevertheless, if we are to use events in the dilepton channel, the event statistics is rather 
low (especially at Tevatron), leading to disadvantages with regard to the sensitivity study. On 
the other hand, if we are to use events in the lepton + jets channel (which has not been tried at 
Tevatron up to now), we suffer from large systematic uncertainties due to the complexity in the 
reconstruction of the spin of a hadronically-decayed top quark. 

At first our claim may seem unreasonable, as one might argue that it is impossible to recon¬ 
struct the spin of an unpolarized top quark: Since an unpolarized state is rotationally invariant, 
there exists no reference direction appropriate for a spin direction. While this argument is correct 
on its own, we can still reconstruct an effective “spin direction” of a top quark, practically useful 
in the analysis of top decay, in the following sense. Unpolarized top quarks can be interpreted as 
an admixture, where one-half of them have their spins in +n direction and the other half have 
their spins in —n direction, for an arbitrary chosen unit vector n. Then the directions of the 
decay products from the top quarks with -|-n spin are strongly correlated with the +n direction, 
provided the top decay interaction is close to the SM prediction. For instance, the charged leptons 
are emitted preferentially in +n direction in the rest frame of the top quark. The same is true 
for the top quarks with —n spin. Then it seems reasonable (at least intuitively) to project the 
direction of the lepton ni onto the n-axis and dehne an effective spin direction as sign(fi-ni) x n, 
for each event. Indeed certain angular distributions of the top decay products with respect to this 
effective spin direction reproduce fairly well the corresponding angular distributions from a truly 
polarized top quark. This is the case even including anomalous couplings. It is in this sense that 
the effective spin direction is practically nsefnl. That we can choose any axis n, and that any 
choice is eqnivalent (if we ignore experimental environment), gnarantee the rotational invariance 
of the nnpolarized state of the top qnark. 

In Sec. 2 we present onr theoretical setnps, namely the definitions of the anomalons conplings 
and theoretical formnlas for the decay angnlar distribntions. In Sec. 3 we propose onr method 
for reconstrncting an effective top spin direction and discnss why it can be nsefnl. The MC 
simnlations nsed in onr analysis are explained in Sec. 4. Sec. 5 demonstrates the kinematical 
reconstrnction of ti events nsing onr likelihood htting method. Sensitivities to the anomalous 
couplings are estimated nsing the selected ti event samples in Sec. 6. Conclnsions are given in 
Sec. 7. In Appendix we present the theoretical formnla for the donble angnlar distribntion when 
we use the effective spin direction. 


2 Anomalous couplings in top decay vertex 


It is conventional to incorporate effects of physics beyond the SM in varions form factors of the 
interactions among the known particles. The interactions of fermions and gange boson, in general, 
can be expressed by six form factors with a particnlar energy scale at which new physics is opened. 
If we assnme that W boson is on-shell, the nnmber of the form factors is rednced to fonr. Thns, 
the effective Wtb vertex relevant to the top qnark decay is expressed as [21] 
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where Vtb is the CKM (Cabibbo-Kobayashi-Maskawa) matrix element [2S1, Pl,r = (1 T75)/2 is 
the left-handed/right-handed projection operator, and k is the momentnm of W. We take the 
convention in which the energy scale is represented by Mw- The form factors and are in 
general complex. At tree-level of the SM, their valnes are = 1 and //^ = /^ = /^^ = 0. We will 
be concerned only with the top qnark decay process t —> bW, where valne is hxed, therefore, 
we treat the form factors as constants (conplings) henceforth. The decay vertex for the antitop 
qnark can be written similarly in a straightforward manner. 

There are some (indirect) constraints to these conplings from measnrements of the FCNC 
processes of rare B decays, b ^ sj and b —>• and from the precision measnrements at Z pole 

p. These measnrements snpport consistency with the SM predictions. Apart from a somewhat 
loose constraint for the parameter, the non-Standard CP-violating and right-handed bottom 
qnark conplings are severely constrained. Taking this into acconnt, and for simplicity of the 
analysis, we assnme in the following that the interactions in Eq. m preserve CP symmetry and 
also neglect the conplings of the right-handed bottom qnark. Hence, Eq. 0 is rednced to 
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where 

/l=/f = /f . f2 = f2^ = fi , (4) 

and both /i and /2 are real. For dehniteness, we have shown both the top and antitop decay vertices 
explicitly. As stated, we have simply neglected and terms. Nevertheless, even if 

they happen to be non-vanishing (bnt not large), their effects are expected to be snppressed, since 
they enter the cross section formnlas qnadratically in the limit mb —> 0, as they do not interfere 
with the SM amplitnde. Hence, onr treatment wonld be jnstihed for a hrst analysis. 

In Fig. HJ we show the partial decay width for t —^ bW for different valnes of /i and /2//1, 
where the tree-level SM corresponds to (/i,/ 2 ) = (1,0). Apart from the overall normalization 
proportional to fi, the partial decay width is a qnadratic fnnction of / 2 //i- One sees that the 
partial decay width is below 10 GeV in a wide region in the (/i,/ 2 ) parameter space. The cnrrent 
resolntion of the reconstrncted top-qnark invariant mass distribntion nsing jet events at Tevatron 
is order 40 GeV. It follows that a wide region in the parameter space (/i,/ 2 ) is still allowed nnder 
the constraint from the present top invariant mass measnrement. 

In principle, we can nse the present measnrement of W helicities jS] for constraining / 2 // 1 . 
No explicit analysis has been given so far, however. From a rongh estimate, we conjectnre that a 
range I/2//1I ~ 0.3 is (at least) scarcely constrained at the present statns. 
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Figure 1: Tree-level partial width for t —> bW as a function of / 2//1 and for different values of /i. The 
unit is in GeV. The tree-level SM prediction corresponds to (/i,/2)=(l,0). 


Let us discuss effects of the anomalous couplings, according to Eqs. m and Q, on the dis¬ 
tribution of the decay products from the top quark. We may separate the dependences of the 
decay distribution on fi and on / 2 // 1 . A variation of /i changes only the normalization of the 
(partial) decay width of the top quark, while a variation of / 2//1 changes both the normalization 
and the differential decay distributions. Since it is difficult to measure the absolute value of the 
decay width accurately in near future, our primary goal will be to measure (constrain) the value 
of / 2//1 from the measurement of the differential decay distribution. An efficient method was 
proposed in [2B] using the decay process of the top quark at future e+e“ collider experiments. 
Noting that only the decay process is concerned, we can apply the main strategy of their method 
to our analysis aimed for hadron collider experiments. The relevant strategy is as follows. Since 
the transverse W boson (denoted as Wt) is more sensitive to /2 than the longitudinal W boson 
(Wl), we can enhance the contribution of Wt using the decay distribution. It is well known that 
the contribution of Wt is dominant when W is emitted opposite to the top spin direction in the 
decay t —>■ bW and also when I is emitted in the opposite direction to W in the decay W ^ lu. 
Hence, we can select these kinematical regions in order to enhance sensitivity to j^/]\- 

The differential decay distribution of W and I in the semi-leptonic decay from a top quark 
with dehnite spin orientation is expressed as j211 
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Here, is the Fermi constant. 6 w is dehned as the angle between the top spin direction and 
the direction of W in the top quark rest frame. 61 is dehned as the lepton helicity angle, which 
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Figure 2: Schematic view of the angles used in Eq. Q. 


is the angle of the charged lepton in the rest frame of W with respect to the original direction 
of the travel of W. (j)i is dehned as the azimuthal angle of I around the original direction of the 
travel of W. A schematic view of the angle dehnitions is shown in Fig. El The hrst term in the 
amplitude on the right-hand-side of Eq. © represents the contribution oiWi, while the second 
term represents the contribution of Wt-"^ 

After integrating over (pi, we obtain the double angular distribution 
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The one-loop QCD correction to the distribution Eq. © within the SM is known M- A large 
part of the correction goes to a variation of the normalization of the partial decay width, which 
amounts to about 9%, whereas the correction to the distribution shape (after the correction to the 
normalization is removed) is at the level of 1-2% or less. For simplicity, in most of the following 
discussion we discard the effect of the QCD correction; see also [221 • 

In Figs. El we show the normalized double angular distribution Al ^(iF(t —> blu)/d cos 9\Yd cos 9i; 
Fig. EKa) corresponds to (/i,/ 2 ) = (1,0) (tree-level SM) and (b) to (/i,/ 2 ) = (1,0.3), respectively. 
Comparing the two hgures, the effects of varying /2 are indeed enhanced in the regions cos 9w — —1 
and cos 9i ~ —1, in accord with enhancement of the Wt contributions in these regions. 

Thus, it is crucial to reconstruct the top quark’s spin orientation in this method. At hadron 
collider experiments, it is much more non-trivial to reconstruct the top quark spin direction, as 
compared to e+e“ collider experiments. We discuss how to reconstruct the top spin direction in 
the next section. 


^We note that the cos 9i distribution is used in the W helicity measurement |3]. 













Figure 3: Normalized differential decay distributions (a) for (/i,/ 2 ) = (1,0), and (b) for (/i,/ 2 ) = 
(1,0.3). They are normalized to unity upon integration. 


3 Effective spin reconstruction 

At hadron colliders, top quarks are produced dominantly through ti production processes. At 
Tevatron, 85% of the produced tt pairs come from qq initial states, while 15% come from gg initial 
states. On the other hand, at LHC, the corresponding fractions are 10% {qq) and 90% {gg), 
respectively. At these colliders, polarization of the produced top quarks is rather small: at tree 
level, produced top quarks are unpolarized; at NLO, polarization of top quarks is reported to be 
very small j2Hl- Therefore, a priori, the spin orientation of a produced top quark is unknown. 
This is in contrast to colliders, where sizable polarization of top quarks is expected due to 
parity-violating nature of the interactions in the top production process. 

In our analysis of the anomalous couplings, we want to utilize correlations between the top 
quark spin direction and the distribution of its decay daughters. As already mentioned, in most of 
the existing analyses, people have considered correlations between the top spin and antitop spin 
in the ti production process. In principle we may use these correlations to reconstruct the spin 
direction of the parent top quark. Namely, we may use the information of the decay distributions 
on the antitop side to reconstruct the top spin direction, and then examine the correlation between 
the top spin direction and the distribution of its decay products. A serious dehcit of such methods 
is that they are quite complicated. For instance, the direction of the down-type quark in the 
hadronic decay of antitop quark is maximally correlated with the antitop spin. Hence, in order to 
reconstruct the spin of the antitop quark, we should distinguish the charges of the quarks from 
W. This is a highly non-trivial task and we anticipate that rather large systematic errors will be 
involved before eventually reconstructing the top quark spin. On the other hand, if we want to 
use semi-leptonic decays both on top and antitop sides, we suffer from lack of statistics, as well 
as it is non-trivial to solve kinematics due to the two missing momenta of the neutrinos. 

Here we take another route for reconstructing (effectively) the top quark spin. We use the 
correlation between the top spin and the direction of the charged lepton in the top decay for 
reconstructing the parent top quark’s spin, and then use it to analyze the decay anomalous cou¬ 
plings of the same top quark. Since we both reconstruct the spin and analyze the spin-dependent 
decay distribution using the same top decay process, we should make sure that we use independent 
correlations in the former and latter procedures to avoid obtaining a meaningless outcome. For 





























this purpose, we take advantage of the following facts: (1) Within the SM, the charged lepton is 
known to be the best analyzer of the parent top quark’s spin and is produced preferentially in the 
direction of the top spin [23 • (2) The angular distribution of the charged lepton with respect to 
the top spin direction (after all other kinematical variables are integrated out) is hardly affected 
by the anomalous couplings of top quark, if the anomalous couplings are small m Therefore, 
we may project the direction of the charged lepton onto an appropriate spin basis; then the re¬ 
constructed top quark spin is scarcely affected by existence of the anomalous couplings /i and /2 
when they are small. It follows that this spin direction is useful in testing the differential decay 
distribution described in the previous section, which is sensitive to the anomalous couplings. 

Provided that produced top quarks are perfectly unpolarized, and provided that we disregard 
kinematical cuts and acceptance corrections, there is no difference on which spin basis we choose to 
project the direction of the charged lepton. Suppose we choose for the basis-axis an arbitrary unit 
vector n in the top rest frame. Then, if the lepton is emitted on the same side as n, i.e. if n ■ p) > 0 
{pi is the lepton momentum in the top rest frame), we define the “spin vector” to be n; on the 
other hand, if n ■ p) < 0, we define the “spin vector” to be —n. The differential decay distribution 
dT/d cos 6 y[/d cos 9i with respect to thus defined “spin vector” can be computed analytically, which 
we present in the Appendix. In Figs.lU we show this double angular distribution for (/i, / 2 ) = (1, 0) 



Figure 4: Normalized differential decay distributions using the reconstructed effective spin direction 
sign(n ■ pi)n for (a) (/i,/ 2 ) = (1,0), and (b) (/i,/ 2 ) = (1,0.3). These figures reproduce well the original 
distributions in Figs. 121 


and (1,0.3). One can see that the distributions approximate the corresponding distributions in 
Figs. El which were computed using the spin direction of a polarized top quark. Qualitative 
features of the bulk distribution shape as well as of the dependence on / 2//1 are reproduced. It is 
this approximation to (reproduction of) the original double angular distribution that guarantees 
a good efficiency of our spin reconstruction method in the analysis of the anomalous couplings. 
See [22] for the study on theoretical aspects of the reconstructed spin direction in this method. 

In practice, if we take into account realistic experimental conditions, different choice of spin 
basis (axis) n leads to different sensitivities to the anomalous couplings, due to effects of kinemat¬ 
ical cuts. Here, we examine three types of spin basis that have been analyzed in the literature, 
then we choose the basis which is most suited for our analysis. 

^More precisely, angular distribution is independent of the anomalous couplings up to (and including) linear 
terms in these couplings. 






























The beamline basis ^3] is to take the spin axis {n) to be either of the initial beamline direction 
in the tt c.m. frame; the helicity basis is to take n to be the direction of top quark in the tt 
c.m. frame; the off-diagonal basis is defined to be a linear combination of the former two bases 
in such a way to maximize the correlation between the t and t spins Advantages and 

disadvantages of these bases have been studied in the context of spin correlations between t and 
t in the ti production processes unmaiiaiiniini.® Nevertheless, these are irrelevant in our spin 
reconstruction method, since we are concerned only with the top quark (or antitop quark) side. 
What are relevant in our analysis are the effects of cuts and acceptance corrections. If we use the 
beamline basis, Et (transverse energy) and \r]\ (pseudorapidity) cuts for leptons and jets strongly 
distort the double angular distribution dV/dcosOy/dcosOi. This is because small Et and large 
\r]\ regions correspond to the regions cos6w — ±1 in this basis, and events that fall into these 
kinematical regions are rejected. In particular, a large part of the enhancement of the / 2//1 effects 
in the region cos 9w ~ —1, cos 9i ~ —1 is lost. At Tevatron, the status of the off-diagonal basis 
is somewhat similar to the beamline basis, since the off-diagonal basis is not very different from 
the beamline basis at Tevatron energies. (At LHC, there is no good definition of the off-diagonal 
basis.) The helicity basis turns out to be an optimal choice for our purpose, since this basis points 
to every direction in the detectors. After integrating over all top quark directions, effects of the 
cuts are averaged over and no significant distortion from the original distribution is found. 

Taking these into account, we define an effective spin direction by a projection of the lepton 
direction onto the helicity basis: 


5sh = sign(cos 0) x ^ , (8) 

\Pt\ 

where 0 is the angle between the charged lepton and the top helicity direction pt/\pt\ (opposite 
of the antitop direction) in the top rest frame. We refer to the above effective spin direction as 
signed-helicity (SH) direction. 

We conclude that the signed-helicity direction (jH)) is a valid spin direction in studying the 
double angular distribution dT/d cos 9wd cos 9i. It is also important that the dependence of the 
distribution on the anomalous couplings is approximately reproduced in this spin reconstruction 
method. 


4 Monte Carlo simulation 

In order to estimate the sensitivity for the anomalous couplings in the top decay, we perform 
Monte Carlo (MC) event generation and detector simulations. The events are produced with 
both Tevatron Run II {pp collisions in ^/s = 1.96 TeV) and LHC {pp collisions in ^/s = 14 TeV) 
conditions. 

The event generation for the tt signal samples is implemented by GR@PPA event generator 
pTT] interfaced by PYTHIA v6.226 showering MC [22] . The GR@PPA produces the hard process 
based on the ti matrix element calculation at the tree level. The whole decay chain of the top 
quark is included in the diagram calculation, so that the spin correlations in the top decay are 
fully reproduced. The anomalous couplings in the top decay are also included. PYTHIA performs 

^The original definition of the beamline basis (off-diagonal basis) is given in the top rest frame (zero-momentum 
frame of the initial partons). For convenience of our analysis, we redefine in the tt c.m. frame. 

®For qq initial state, the spin correlation is 100% in the off-diagonal basis. The spin correlation in the beamline 
basis is somewhat smaller but considerably larger than that in the helicity basis. 



fragmentation, parton showering, and hadronization. On the other hand, underlying events are 
produced by PYTHIA alone, using the parameters tuned to reproduce the Tevatron real data. 

The detector simulation is performed by smearing energies for the stable particles deposited 
into a proper segmentation of the calorimeter geometry. The detector is assumed to stretch in 
absolute pseudorapidity (Ir^l) up to 3.0 and be segmented by 0.1 r] bins and 15°0 (azimuthal) bins. 
The transverse energies Et for undecayed particles are summed up in each bin and are smeared 
by Gaussian distribution with 75% x ^/ET standard deviation in GeV.® As for leptons, we replace 
their measured momenta by the values at the generator level. 

Although our MG simulations are not fully realistic, we consider them to be useful for giving 
rough estimates of the sensitivity to the anomalous couplings before performing full simulations. 
In particular, as for Tevatron experiments, our MG simulation would give quite reasonable results. 
On the other hand, as for LHG studies, there are some other important ingredients that should 
be taken into account before giving more realistic estimates of the sensitivity. Among them, the 
most important effects would be those of extra jets events, i.e. ti + n-jets events, which are not 
included in our event generation. Their effects are expected to be small at Tevatron. 

A jet is clustered by PYCELL routine in PYTHIA with cone size 0.4. We do not simulate b 
tagging. Instead a 6 -jet is identified as the nearest jet with the minimum separation AR between 
a jet and a 6 -quark at the generator level. The separation {AR) is defined as 

AR = ^A(t)^ + A 772 , (9) 

where A0 and Arj are the separation in the azimuthal angle and the pseudorapidity for every pair 
of a jet and 6 -quark at the generator level, respectively. 

We select the lepton + jets channel in the ti production process by requiring to pass the cuts 


Tevatron LHG 


lepton 

Pt a 20 GeV, 

1^1 

< 

1.0 

Pt > 20 GeV, 

1^1 

< 

2.5 

6 -jet 

Et > 15 GeV, 

\v\ 

< 

1.0 

Et Y 30 GeV, 

\v\ 

< 

2.5 

other jet 

Et > 15 GeV, 

\v\ 

< 

2.0 

Et Y 30 GeV, 

\v\ 

< 

2.5 


EfT Y 20 GeV 




EfT Y 20 GeV 





where Efrp the missing transverse energy calculated by the vector summation of the candidate 
lepton and four jets. We require two 6 -jets within at least 4 jets in each event. 

The detection efficiency is 1.2% including acceptance corrections and branching fraction of tt 
events to the lepton+jets channel, with 25% double 6 -tagging efficiency at Tevatron condition; the 
corresponding detection efficiency is 2.3 % with 60% double 6 -tagging efficiency at LHG condition. 
Kinematical acceptance fluctuates only within 0.5% for various values of the anomalous couplings. 


5 Event reconstruction 

We measure the double angular distribution of W and the charged lepton. For this purpose, it is 
important to reconstruct the full event topology of top quark events. The reconstruction of the ti 
event topology is performed by a likelihood method on event by event basis, using the lepton+jets 
events selected as above. Our kinematical likelihood event reconstruction is based on that of ra, 
which is a dedicated study for top quark reconstruction at future e’''e linear colliders. In order 
to apply it to hadron collider experiments, some modifications are implemented. We assume that 
the energy-momentum of leptons and directions of jets can be measured accurately. Thus, for the 


®We used the PYTHIA machinery to implement these resolution effects. 




lepton + jets channel, we treat only 5 parameters out of 16 kinematical parameters as unknown. 
These 5 parameters are assigned to be the Et of jets and the boost vector of ti c.m. system along 
the beam axis. We neglect the transverse momentum of the tt system. The £t is constrained by 
the top quark mass, W mass and parton distribution function (PDF). Our likelihood function is 
formed as 


L 




■ ■ a. ■ n,- ■ ^ 


tt 

ZpDF ’ 


( 10 ) 


where is the jet response function that relates the measured jet energy to the corresponding 
parton-level energy; Breit-Wigner functions^ for hF+, IF”, t and 

f, respectively; PzpoF constrains the boost momentum of the ti c.m. system by PDF function. 
Whenever more than one solution for jet assignment is found in each ti candidate event, we take 
the one that maximizes the likelihood function. 

The jet response functions are constructed for the light-quark jets from W and for the 6-jets 
separately in the following manner. A single parton generator is used to estimate them. A parton 
with a certain hxed energy and direction is generated and passed through the detector simulation. 
The energy of the reconstructed jet at the detector level is htted by Gaussian distribution and 
is dehned to be the probability density for the given energy and direction of the parent parton. 
We iterate this procedure with various energies and directions, and dehne jet energy scales of the 
responses in the calorimeter positions as the jet response functions. 

Let us demonstrate how well the parton kinematics are reconstructed. In Figs. El we show the 
difference between the parton energy at the generator level and the energy determined by the fit at 
the detector level: we show the energy differences for (a) the leptonically-decayed W boson, (b) the 
hadronically-decayed W boson, (c) the leptonically-decayed top quark, and (d) the hadronically- 
decayed top quark, respectively. The fake contributions are also shown as hatched regions, which 
correspond to the events that include jets not assigned in correct combinations by the £t. (We 
dehne that jets are correctly assigned, if the directions of all jets are matched with those of the 
original partons within jet cone radius of 0.4.) For comparison, the other reconstruction methods 
“perfect correction” and “average correction” are also presented in the hgures. With the “perfect 
correction”, the jet energy is dehned to be the corresponding parton energy at the generator 
level smeared with a hnite detector resolution. With the “average correction”, the jet energy is 
uniformly corrected by the jet energy scale for the mean value.^ Note that the fake contributions 
are not included for these two correction methods. 

From Figs. El we can see that the likelihood fitting method reproduces the event kinematics 
considerably better than the other two methods. Quality of the energy reconstructions of W and 
top quark is worse on the leptonic side than on the hadronic side. This follows from a poorer 
resolution for the neutrino momentum on the leptonic side, which is dehned as the opposite of the 
vector summation of all (four) jets and lepton in the ti c.m. frame. On the other hand, W and 
top quark on the hadronic side are reconstructed using the two and three jets, respectively. One 
sees that, in the tail regions of the distributions in the hgures, the correctly assigned events are 
suppressed, which also shows that the likelihood htting works as expected. 

Using the reconstructed momenta of t and i, we reconstruct the ehective top spin according 
to the signed-helicity method Eq. (jH)) as follows. The top helicity axis is dehned in the top quark 
rest frame as (the opposite of) the direction of the momentum of the hadronically-decayed antitop 
quark, which sequentially decayed into three jets. The sign of the top spin is dehned by the 

^We fix the top quark pole mass to be 178 GeV. 

® Jet energy reconstruction methods similar to the “average correction” is being used in current studies on LHC 
experiments. 






(b) 




(c) (d) 

Figure 5: Deviations between the parton energies at the generator level and corrected jet energies at the 
detector level for (a) leptonically decayed W boson, (b) hadronically decayed W boson, (c) leptonically 
decayed top quark, and (d) hadronically decayed top quark. 


direction of the charged lepton in the top rest frame. The reconstructed top quark momentum is 
also used to measure the helicity angle of the charged lepton, since the original direction of W in 
the W rest frame is equivalent to the opposite of the leptonically-decayed top quark direction in 
the W rest frame (see Sec. n. 

6 Sensitivity study 

In this section, we study the sensitivity for the anomalous couplings using the lepton+ jets events 
reconstructed by the kinematical likelihood htting. 

We show in Figs. El the double angular distributions dT/d cos 9^ cos 9i using the MC events, 
after event selection and event reconstruction by the kinematical likelihood htting. Compare with 
the corresponding parton distributions at the generator level in Figs. |31 One can see that, even 
after cuts, the dependence on the anomalous couplings remains in the Wt region {cos 9w ~ —1, 
cos 6 *; ~ — 1 ). 

The difference between the angular distributions corresponding to the anomalous couplings 











































































Figure 6 : Normalized differential decay distributions using the signed-helicity direction after event re¬ 
construction and kinematical cuts (a) for (/i,/ 2 ) = (1,0), and (b) for (/i,/ 2 ) = (1,0.3). 



Figure 7: Deviation of the normalized angular distribution when the anomalous couplings are varied 
from (/i,/ 2 ) = (1,0) to (1, 0.3). 


(/i,/ 2 ) = (1,0.3) and (1,0) is shown in Fig. 0 The difference is maximized in the Wt region 
{cos 9w ~ — 1 , cos 6 *; ~ — 1 ) and minimized in its diagonal opposite region {cos 9w ~ 1 , cos 9i ~ 1 ). 
The other two (diagonal) regions have weaker dependences on the anomalous couplings. When 
signal statistics is small or the background contribution is not well-understood, a simple but not 
elaborate method to determine the anomalous couplings would be practical for a first analysis. 
Hence, we divide the kinematical region into 4 regions and simply count the number of events in 
each region. The regions are defined as follows: 


Region A : 

-1 

< 

cos 9w 

< 

0 

and 

-1 

< 

cos 9i 

< 

0 

Region B : 

-1 

< 

cos 9w 

< 

0 

and 

0 

< 

cos 6*; 

< 

1 

Region C : 

0 

< 

cos 9w 

< 

1 

and 

-1 

< 

cos 9i 

< 

0 

Region D : 

0 

< 

cos 9w 

< 

1 

and 

0 

< 

cos 9i 

< 

1 


The dependences of the event fractions in these regions on the anomalous couplings are shown 
in Fig. IHl The regions A and D are the regions most sensitive to the anomalous couplings, while 
the regions B and C are less sensitive regions. We can see that the event fraction in region A 




































































Figure 8: MC data and fitting results of the event fractions in each region as functions of / 2 //i- Each 
region is defined in Eq. CH). 


increases with / 2//1 when / 2//1 > 0, and takes a minimum value around / 2//1 ~ —0.45, and then 
increases again if we lower / 2//1 below —0.45. The event fraction in region D has an opposite 
behavior to that of region A. All the event fractions take maximum or minimum values around 
/ 2//1 = —Mw/Mt ~ —0.45, where the transverse component of W is canceled; cf. Eq. d?]). 

We £t the MC data (shown by discrete points in Fig.lH]) by analytic functions as follows. In an 
ideal case, we can integrate Eq. (USD analytically over each of the regions A-D. The event fraction 
distributed in each region takes a form 


F\x) 


a\x‘^ + + al 



i = A, B, C, D 


( 12 ) 


where Ttotla:) ^ (r,^ 6 w(/i,/r) is the partial decay width of the top quark.) 

Parameters 0 ^, 03,03 can be expressed analytically in terms of the top and W masses. Note that 
since /i only contributes to the normalization of the differential angular distribution which does 
not affect the shape of the distribution, the event fractions depend only on a; = / 2//1 regardless 
of various choices of /i and / 2 . 

In a realistic case, the distributions are affected by the hnite resolution of detectors, by cuts, 
by fake contributions, etc. Here, we £t the event fractions generated by MC simulation with high 
statistics by the same functional form as in Eq. (ED, taking a\,al,al as the parameters to be 
determined by the £t. The sum of the event fractions in four regions is normalized to one, so that 
9 parameters are decided by minimizing the fitting The MC data and fitting results of the 
event fractions in each region are shown as functions of / 2//1 in Fig. |H1 The minimum per each 
degree of freedom takes a reasonable value ~ 1.20. The functions F^{x) determined by the £t are 
used to estimate sensitivity to the anomalous couplings. 

In Table m the expected bounds on the coupling ratio at 95% C.L. are shown, corresponding 
to 100 and 1000 selected events (after cuts) for the Tevatron experiment and 100k selected events 
(after cuts) for the LHC experiment, respectively.® Input parameters of the MC simulations are 


®Using the detection efficiencies estimated at the end of Sec. 4, 100 and 1000 double 6-tagged events at Tevatron 













































Number of events 

Tevatron (y/i = 1.96 TeV) 

LHC (Vs = 14 TeV) 

100 

1000 

100k 

Signed-helicity direction 

-0.93 < ^ < 0.57 
h 

-0.12 < f < 0.14, 
-0.81 <f< -0.70 

ji 

-0.01 < f < 0.01, 

-0.74 <f< -0.72 

./I 

Ideal off-diagonal direction 

-0.84 < ^ < 0.50 
h 

-0.11 < w < 0.12, 
-0.73 <f< -0.61 

ji 

Not applicable 

Signed-helicity direction 
with correct 6 assignment 

-0.29 < w < 0.39, 

-0.89 <f< -0.59 
__ 

-0.09 < w < 0.10, 

-0.80 <f< -0.71 
__ 

-0.01 < # < 0.01, 

-0.75 <f< -0.74 
_ n _ 


Table 1: Expected bounds at 95% C.L. corresponding to 100 and 1000 events (after cuts) for Tevatron and 
100k events (after cuts) for LHC. Input parameters of the MC simulations are taken as (/i,/ 2 ) = (1;0). 
Only statistical errors are taken into account. For comparison, the bounds using an ideal off-diagonal 
direction, and those using only the events with correct assignment of two 6-jets in the signed helicity 
method are presented. 


taken as (/i,/ 2 ) = (1,0) (tree-level SM values). Only statistical errors are taken into account 
to obtain the allowed regions. For comparison, we present the allowed regions using an ideal 
off-diagonal direction (for Tevatron), in which the spin direction is reconstructed using the off- 
diagonal basis with the sign ambiguity resolved by looking into the information at the generator 
level; we may consider that this ideal off-diagonal direction approximates the true spin direction 
well, so that the corresponding results can be used as references (although these include effects 
of kinematical cuts as well as contamination by fake events). We also present the allowed regions 
using only the events with correct assignment of two 6 -jets using the signed helicity direction. 

In Table ^ the bounds using the signed helicity direction are not very different from those 
using the ideal off-diagonal spin direction at Tevatron. Since the latter results can be regarded as 
references for optimal reconstruction of the top spin, it is seen that the signed helicity direction is 
quite efficient for this analysis. In addition, the sensitivities can be improved if we can remove 
misassignment of the 6 -jets. 

Although it is obvious that the expected bound becomes tighter as the number of events 
increases, the way the bound shrinks with statistics is rather peculiar. This is because the event 
fractions have characteristic (non-linear) / 2 //i-dependences, almost symmetric under reflection 
with respect to / 2//1 ~ —0.45; see Fig. |H1 At low statistics (100 events or less), the bound 
on / 2//1 is fairly loose. When the statistics is increased, the bound does not simply scale with 
1/a//V but becomes narrower much faster, with a two-fold ambiguity that remains, i.e., the regions 
around / 2//1 ~ 0 and / 2//1 ~ —0.75 cannot be discriminated. Once the number of events exceeds 
a few hundred, the bound scales with l/y/N, since the dependences of the event fractions can be 
approximated by linear responses. This gives a motivation to increase the number of events (after 
cuts) at least beyond a few hundred at Tevatron experiment. 

Finally, we show the expected excluded regions in the (/ 2 , /i)-plane at 95% C.L. for the Teva¬ 
tron case in Fig. IHl We anticipate that our method allows us to cover a wide region in the 
parameter space even in this simplihed counting experiment. 

are translated roughly to 1 and 10 fb“^ integrated luminosities, respectively, and 100k events to 10 fb“^ at LHC. 

^°In [221, the sensitivity using the effective spin direction is estimated to be about half of that using the true spin 
direction, if we ignore experimental environment. Here, we have shown that at Tevatron the effects of kinematical 
cuts are quite large if we use the idal off-diagonal spin basis (true spin direction), so that after the cuts, the 
sensitivities are not very different whether we use the signed-helicity direction or the idal off-diagonal spin basis. 













Figure 9: Expected excluded regions at 95% C.L. in the (/ 2 ,/i)-plane at Tevatron. The shaded regions 
correspond to 1 fb“^, 2 fb“^, and 10 fb“^ integrated luminosities, respectively. The input SM point is 
located at (/ 2 ,/i)=( 0 ,l). 


7 Conclusions 

We have studied sensitivities to the top quark decay anomalous couplings /i and /2 at hadron 
colliders, taking into account realistic experimental conditions expected at Tevatron and LHC. 
Since large samples of top quarks are expected at these colliders, and since the decay processes 
of the top quark can be predicted reliably by perturbative QCD, we can achieve high sensitivities 
to the anomalous couplings from detailed studies of the top quark decay processes. We used a 
likelihood method to fully reconstruct the momenta of the partons in the lepton+4 mode. 
Furthermore, we devised a new method for reconstructing an effective spin direction Eq. (jS)) 
(referred as signed-helicity direction) of the leptonically-decayed top quark. It is dehned as the 
projection of the lepton direction onto the top helicity axis in the top rest frame. This method 
does not require reconstruction of the spin of the hadronically-decayed top quark, hence it helps 
to elude possibly large systematic uncertainties. These two techniques, when used in combination, 
revealed to be quite powerful for the sensitivity study. 

We analyzed a double angular distribution dV{t blu)/d cos 9wd cos 9i. The Wt region 
cos9w ~ —1, cos 9i ~ —1 of the distribution is sensitive to the ratio of the anomalous cou¬ 
plings / 2 //i- We conhrmed that this feature is preserved even after kinematical cuts. We note 
that if we choose a spin axis other than top helicity basis, such as beamline basis or off-diagonal 
basis, sensitivity to / 2//1 is substantially reduced due to effects by the kinematical cuts. 

In order to give reliable estimates, we developed an event generator incorporating in the matrix 
element proper spin correlations of partons as well as the anomalous couplings in the top decay 
vertices. We also simulate the detector effects by assuming a simple geometry and energy resolu¬ 
tions based on the CDF and ATLAS detectors for Tevatron and LHC experiments, respectively. 
After event selection, the event kinematics are reconstructed by the kinematical likelihood htting 
on an event by event basis. It not only improves the jet energy scale from the measured jet energy 
to the corresponding parton energy but also helps to select the correct conhguration of the jets 
in the top event topology. Furthermore, the likelihood htting method improves reconstruction 



























of the hadronically-decayed top quark’s energy and momentum, which is directly reflected to the 
determination of the top spin direction as well as lepton helicity angle. 

As a hrst analysis, we simply counted the event fractions of the double angular distribution 
divided into 4 regions. Then we performed y^-hts to these event fractions in order to hnd sensi¬ 
tivities to The results can be summarized as follows. The bounds obtained at 95% C.L. 

read 


—0.93 < ^ < 0.57 for 100 reconstructed events at Tevatron, 

—0.81 < ^ < —0.70, — 0.12 < ^ < 0.14 for 1000 reconstructed events at Tevatron, (13) 

—0.74 < ^ < —0.72, — 0.01 < ^ < 0.01 for 100k reconstructed events at LHC. 

We took into account only the statistical errors and neglected systematic errors. Due to charac¬ 
teristic dependences of the event fractions on / 2 // 1 , the bound on / 2//1 shrinks quickly as the 
number of top quark events increases up to a few hundred. For more events, the bound scales 
with 1/v^, and there remains a two-fold ambiguity for the allowed ranges of / 2 //i- 

Although some simplihcations have been made, we consider that our MC study for the Tevatron 
experiment imitates realistic experimental conditions closely enough to give reasonable estimates 
for the sensitivities to the anomalous couplings. On the other hand, as for the LHC case, some 
important ingredients are still missing in the MC simulation (the most important one would be 
tt -|- n-jets events), so our results should be taken as hrst rough estimates. 

Since our methods for event reconstruction and effective top spin reconstruction are fairly 
simple, we would expect that they can be applied to other analyses, such as precise determination 
of W polarization states in top decay. 
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Appendix: Decay angular distribution using the signed- 
helicity spin direction 


In this Appendix, we present the analytic formula for the double angular distribution in the decay 
of top quark, dT/d cos 9wd cos 9i, when we use the lepton direction projected onto any spin basis 
for the reconstructed top quark spin direction. (When we choose the helicity basis, we call the 
reconstructed spin direction as “signed-helicity” direction.) We assume the parent top quark to 
be unpolarized and neglect the effects of kinematical cuts. 

An arbitrary unit vector n is chosen as the spin axis in the top rest frame. Then, if n ■ p) > 0, 
we dehne the “spin vector” to be n whereas, if n ■ p) < 0, we dehne the “spin vector” to be —n. 
The differential decay distribution dT/d cos 9wd cos 9i with respect to thus dehned “spin vector” 
can be computed analytically as follows. The angle 0 between n and p) is given by 


n-Pi \/l -/3^ 

cos 0 = —rr = , .o - -hr 

\pi\ 1 +fJw cos9i 

M?-M^ 

M? + Mh 


sin 9i cos (pi sin 9w + 


cos 9i -f f3\Y 
\/l ~ (^w 



(14) 

(15) 


where 9w and (pi are dehned as in Fig. |21 with respect to n. Since the dehnition of the spin vector 
is reversed when cos 0 < 0, in this case we need to redehne the angles to be 9\y —>■ tt — 9w 
and (pi (pi + IT in the cross section formula. Therefore, noting that the initial top quark is 
unpolarized, the double angular distribution is given by 


LiL yi 


dcos9\Ydcos9i J gj^ 

dVit^bW^ blv) 
dcos9wdcos 9id(pi 


'dT{t -^bW^ blv) 
d cos 9wd cos 9id(pi J 


/ d(pi 
I cos 0>O 


-I 


+ 

/ d(Pi 

- unpol. 

JcosQ<0 


'dT{t ^bW^ blv) 
d cos 9wd cos 9id(pi 


unpol. 


— >7r—9\Y 


X 


29 M, 


( 16 ) 


where 


y = 

9{x) 


VI 



if a; > 1 
if a; < —1 
if —1 < X < 1 


(17) 

( 18 ) 


The decay distribution from an unpolarized top quark is given by 


dT{t ^bW^ blv) 
d cos 9wd cos 9id(pi 


- unpol. 


4 




• 4 
Sin — 




( 19 ) 


It is independent of 9w and (pi, since there is no reference spin vector. 
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